Papers with Linguistic Theories
Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (2020.aacl-main)
Copied to clipboard
| Challenge: | asian-pacific chapter of AACL is hosting its first conference in 2020 . a face-to-face physical meeting would have been eye-opening to participants . |
| Approach: | ai chiang is the General Chair of the Asia-Pacific Chapter of the Association for Computational Linguistics . he is also the General chair of the 10th International Joint Conference on Natural Language Processing . |
| Outcome: | the 1st Asia-Pacific Chapter of the Association for Computational Linguistics will hold its annual conference in 2020 . the conference will be held in conjunction with the 10th International Joint Conference on Natural Language Processing . |
Number Theory Meets Linguistics: Modelling Noun Pluralisation Across 1497 Languages Using 2-adic Metrics (2022.aacl-short)
Copied to clipboard
| Challenge: | Existing evidence to support p-adic neighbourhoods in languages is lacking . pmetrics are based on prime numbers and have infinitesimals to support calculus and triangle inequality to support geometry. |
| Approach: | They propose to use a linear regression problem to model pluralisation as a p-adic metric. |
| Outcome: | The proposed model outperforms Euclidean-space regressors on languages in Indo-European, Austronesian, Trans New-Guinea, Sino-Tibetan, Nilo-Saharan, Oto-Meanguean and Atlantic-Congo families. |
Measuring the perceptual availability of phonological features during language acquisition using unsupervised binary stochastic autoencoders (N19-1)
Copied to clipboard
| Challenge: | Xitsonga and English are typologically unrelated languages . phonological features are not directly observed by humans . |
| Approach: | They deploy binary stochastic neural autoencoder networks as models of infant language learning in two typologically unrelated languages. |
| Outcome: | The proposed model is well represented in both languages, while others are less so. |
Phase Transitions in Affective Meaning Divergence: The Hidden Drift Before the Break (2026.acl-srw)
Copied to clipboard
| Challenge: | a couple's locutionary act is identical, but the illocutionary force received diverges from the force intended. |
| Approach: | They propose a logit best-response map with a hysteretic collapse of repair coordination . they propose lexical divergence variance, AMD variance, dialog-act repair variance . |
| Outcome: | The proposed model shows that derailing conversations exhibit critical-slowing-down signatures across multiple levels. |
Ranking of Potential Questions (P19-2)
Copied to clipboard
| Challenge: | linguistic theories of discourse structure view questions and their answers as the main structuring element in discourse. |
| Approach: | They propose a ranking system for questions by their appropriateness in a dialogue . system implements constraints and principles put forward by linguistic theories . |
| Outcome: | The proposed system implements constraints and principles put forward in the linguistic literature. |
GCM: A Toolkit for Generating Synthetic Code-mixed Text (2021.eacl-demos)
Copied to clipboard
| Challenge: | Code-mixing is a spoken language phenomenon and is difficult to train in multilingual communities. |
| Approach: | They propose a tool that can automatically generate code-mixed data given parallel data in two languages. |
| Outcome: | The proposed tool can generate code-mixed data in two languages using two linguistic theories. |
Optimizing over subsequences generates context-sensitive languages (2021.tacl-1)
Copied to clipboard
| Challenge: | Optimality Theory is a framework that is commonly used to model phonology but it is known to generate non-finite-state mappings and languages. |
| Approach: | They propose to use Optimality Theory to generate non-context-free languages using constraints defined over subsequences to demonstrate its generative capacity. |
| Outcome: | The proposed framework is capable of generating non-context-free languages with minimal modification as it is standardly employed. |
Vote’n’Rank: Revision of Benchmarking with Social Choice Theory (2023.eacl-main)
Copied to clipboard
Mark Rofin, Vladislav Mikhailov, Mikhail Florinsky, Andrey Kravchenko, Tatiana Shavrina, Elena Tutubalina, Daniel Karabekyan, Ekaterina Artemova
| Challenge: | ML benchmarks have been criticized for their construct validity, fragility of the design and task choices. |
| Approach: | They propose a framework for ranking systems in multi-task benchmarks under the principles of the social choice theory and propose 'vote'n'rank' procedures are more robust than the mean average while being able to handle missing performance scores and determine conditions under which the system becomes the winner. |
| Outcome: | The proposed framework can be utilised to draw new insights on benchmarking in several ML sub-fields and identify the best-performing systems in research and development case studies. |
The Importance of Modeling Social Factors of Language: Theory and Practice (2021.naacl-main)
Copied to clipboard
| Challenge: | Current NLP models focus on information content while ignoring language’s social factors. |
| Approach: | They propose that NLP systems focus on information content while ignoring language’s social factors to improve performance. |
| Outcome: | The proposed approach improves the performance of existing systems, open up new applications, and increase fairness and usability for all users. |
On the Intersection of Context-Free and Regular Languages (2023.eacl-main)
Copied to clipboard
| Challenge: | We generalize the Bar-Hillel intersection construction so that the given WFSA may contain -arcs. |
| Approach: | They propose a construction that generalizes the Bar- Hillel in the case the desired automaton has -arcs and generalize the weighted extension so that the given WFSA may contain arcs. |
| Outcome: | The proposed construction can encode the structure of both the input automaton and grammar while retaining the asymptotic size of the original construction. |
Modeling Non-Cooperative Dialogue: Theoretical and Empirical Insights (2022.tacl-1)
Copied to clipboard
| Challenge: | a robust dialogue agent cannot assume a cooperative conversational counterpart when deployed in the wild. |
| Approach: | They propose a theoretical model for identifying non-cooperative interlocutors . they use reinforcement learning to implement multiple communication strategies . |
| Outcome: | The proposed model is validated by using reinforcement learning to implement multiple communication strategies. |
The lack of theory is painful: Modeling Harshness in Peer Review Comments (2022.aacl-main)
Copied to clipboard
| Challenge: | a new study shows that peer-review has a power imbalance, making it fraught for authors . authors argue that a little more effort to remain critical but be constructive would help foster a positive outcome . |
| Approach: | They propose to use a dataset to show peer-review comments' harshness scores . they argue that this moderation could help authors to be more constructive . |
| Outcome: | The proposed dataset shows that it can be used to make peer reviews less hurtful and more welcoming. |
Unit Testing for Concepts in Neural Networks (2022.tacl-1)
Copied to clipboard
| Challenge: | Existing theories of language and cognition hold that these representations are structured in a compositional way and that the meanings of composite concepts (''gray car'') are inherited predictably from the meaning of the parts. |
| Approach: | They propose to test models for determining whether a system’s behavior is consistent with several key aspects of Fodor’s criteria. |
| Outcome: | The proposed models succeed on tests of groundedness, modularity, and reusability of concepts, but important questions about causality remain open. |
Building an English Vocabulary Knowledge Dataset of Japanese English-as-a-Second-Language Learners Using Crowdsourcing (L18-1)
Copied to clipboard
| Challenge: | a dataset for analyzing the English vocabulary of English-as-a-second language learners is available . a vocabulary size test was performed by 100 test takers hired via crowdsourcing . |
| Approach: | They propose a dataset for analyzing the English vocabulary of English-as-a-second language learners. |
| Outcome: | a dataset for analyzing the English vocabulary of English-as-a-second language learners is available online . the results show that the test is reliable and can be predicted with high accuracy . |
Comparing Test Sets with Item Response Theory (2021.acl-long)
Copied to clipboard
Clara Vania, Phu Mon Htut, William Huang, Dhara Mungra, Richard Yuanzhe Pang, Jason Phang, Haokun Liu, Kyunghyun Cho, Samuel R. Bowman
| Challenge: | Recent results from large pretrained models show that many datasets are saturated and unlikely to detect further progress. |
| Approach: | They evaluate 29 datasets using predictions from 18 pretrained Transformer models on individual test examples. |
| Outcome: | The proposed datasets are saturated and unlikely to detect future improvements. |
On the Effectiveness of Automated Metrics for Text Generation Systems (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluation methods lack a sound theoretical foundation for evaluation campaigns . imperfect automated metrics and insufficiently sized test sets are some of the factors that cause uncertainty. |
| Approach: | They propose a theoretical framework that incorporates different sources of uncertainty, such as imperfect automated metrics and insufficiently sized test sets. |
| Outcome: | The proposed model can be leveraged to improve evaluation protocols regarding reliability, robustness, and significance of the evaluation outcome. |
Detecting Narrative Elements in Informational Text (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent work has focused on identifying narrative elements in personal stories texts, but this paper focuses on informational texts. |
| Approach: | They propose a novel NLP task for detecting narrative elements in raw text by adapting elements from the oral narrative theory of Labov and Waletzky and adding a new narrative element of their own. |
| Outcome: | The proposed scheme achieves an average F1 score of 0.77 and is better suited for informational texts than the oral narrative theory. |
Theory-Grounded Computational Text Analysis (2023.acl-short)
Copied to clipboard
| Challenge: | A broad space separates its two constituent disciplines—natural language processing and social science—which has to date been sidestepped rather than filled by applying increasingly complex computational models to problems in social science research. |
| Approach: | They argue that computational text analysis lacks organizing principles and requires organizing methods to solve problems. |
| Outcome: | The proposed approach is based on a review of 60 papers on computational text analysis. |
ALBA: Adaptive Language-Based Assessments for Mental Health (2024.naacl-long)
Copied to clipboard
| Challenge: | Adaptive language-based assessments require a substantial sample of words per person for accuracy. |
| Approach: | They propose an adaptive language-based assessment task that involves ordering questions and scoring latent psychological trait using limited language responses to previous questions. |
| Outcome: | The proposed methods improve over non-adaptive baselines, but are more accurate and scalable with fewer questions. |
TZOS: an Online Terminology Database Aimed at Working on Basque Academic Terminology Collaboratively (2022.lrec-1)
Copied to clipboard
| Challenge: | TZOS is an online terminology database to work collaboratively on academic terminology. |
| Approach: | They propose to use a terminology database to work collaboratively on academic terminology. |
| Outcome: | The proposed tool integrates the Communicative Theory of Terminology and the methodological matters with the real corpus GARATERM. |
What determines the order of adjectives in English? Comparing efficiency-based theories using dependency treebanks (2020.acl-main)
Copied to clipboard
| Challenge: | Across languages, there exist strong and stable constraints on the order of adjectives when multiple adjectives modify a noun . adverb order is a crucial testing ground for quantitative theories of syntax . |
| Approach: | They propose four quantitative theories that are motivated by efficiency in human language production and comprehension. |
| Outcome: | The proposed theories predict order of adjectives in hand-parsed and automatically-parsed dependency treebanks. |
Understanding “Democratization” in NLP and ML Research (2024.emnlp-main)
Copied to clipboard
| Challenge: | a large number of NLP and ML papers mention terms related to democracy . authors find that democratization is most frequently used to convey (ease of) access to or use of technologies without meaningfully engaging with theories of democratisation. |
| Approach: | They analyze papers using the term "democra*" to clarify how it is understood in NLP and ML . they find that democratization is most frequently used to convey (ease of) access to or use of technologies . |
| Outcome: | The authors analyze papers using the term "democra*" they find that democratization is most frequently used to convey (ease of) access to or use of technologies without meaningfully engaging with theories of democratisation. |
Leveraging Dual Process Theory in Language Agent Framework for Real-time Simultaneous Human-AI Collaboration (2025.acl-long)
Copied to clipboard
Shao Zhang, Xihuai Wang, Wenhao Zhang, Chaoran Li, Junru Song, Tingyu Li, Lin Qiu, Xuezhi Cao, Xunliang Cai, Wen Yao, Weinan Zhang, Xinbing Wang, Ying Wen
| Challenge: | Large language models (LLMs) excel in turn-by-turn human-AI collaboration but struggle with simultaneous tasks requiring real-time interaction. |
| Approach: | They propose a language agent framework that integrates *System 1* and *System 2* for efficient real-time simultaneous human-AI collaboration. |
| Outcome: | The proposed framework improves on existing LLM-based agents and human collaborators by integrating Theory of Mind and asynchronous reflection to infer human intentions and perform reasoning-based autonomous decisions. |
What is Stigma Attributed to? A Theory-Grounded, Expert-Annotated Interview Corpus for Demystifying Mental-Health Stigma (2025.acl-long)
Copied to clipboard
| Challenge: | Existing resources for training neural models to finely classify mental-health stigma are limited, relying primarily on social media or synthetic data without theoretical underpinnings. |
| Approach: | They propose to use an expert-annotated corpus of human-chatbot interviews to finely classify mental-health stigma. |
| Outcome: | The proposed corpus can facilitate research on computationally detecting, neutralizing, and counteracting mental-health stigma. |
Do Charge Prediction Models Learn Legal Theory? (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for charge prediction are sensitive, selective, and presumption of innocence . a recent study has shown that deep learning models can predict the charges accurately, but their reliability and interpretability are still underexplored. |
| Approach: | They propose that trustworthy charge prediction models should take legal theories into consideration . they propose three principles for trustworthy models to follow in this task . |
| Outcome: | The proposed framework evaluates whether existing models learn legal theories . it shows that models meet selective and presumption of innocence principles . |
Towards an ISO Standard for the Annotation of Quantification (L18-1)
Copied to clipboard
| Challenge: | Quantification occurs in every sentence of written text or spoken discourse because application of a predicate to one or more sets of objects gives rise to questions of relative scope, of cardinality, and of distribution (or 'distributivity') of the predicacy over the sets of arguments. |
| Approach: | They propose an approach to the annotation of quantification that is being developed as part of an effort by the International Organisation for Standardisation ISO to define interoperable semantic annotation schemes. |
| Outcome: | The proposed scheme includes both count and mass NP quantifiers, as well as NPs with syntactically and semantically complex heads with internal quantification and scoping structures. |
What company do words keep? Revisiting the distributional semantics of J.R. Firth & Zellig Harris (2022.naacl-main)
Copied to clipboard
| Challenge: | linguists J.R. Firth and Zellig Harris are often credited with the invention of "distributional semantics" a close reading of their work uncovers two distinct and in many ways divergent theories of meaning . |
| Approach: | They propose to compare two different theories of meaning that focus on internal workings of linguistic forms with a broader cultural and situational context. |
| Outcome: | The authors examine the differences between their theories of meaning and the internal workings of linguistic forms . they find that Firth could guide the field towards a more culturally grounded notion of semantics . |
A Unifying Theory of Transition-based and Sequence Labeling Parsing (2020.coling-main)
Copied to clipboard
| Challenge: | Existing parsers that read sentences from left to right are not learning to parse them. |
| Approach: | They propose a mapping from transition-based parsing algorithms that read sentences from left to right to sequence labeling encodings of syntactic trees. |
| Outcome: | The proposed algorithms are learnable and comparable to existing encodings. |
Textual Time Travel: A Temporally Informed Approach to Theory of Mind (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models that attribute mental states to oneself and others perform poorly on false belief tasks where beliefs differ from reality. |
| Approach: | They propose a temporally informed approach for improving the theory of mind capability of memory-augmented neural models by integrating priors about entities’ minds and tracking their mental states over time through an extended passage. |
| Outcome: | The proposed model improves performance on false belief tasks where beliefs differ from reality, especially when the dataset contains distracting sentences. |
QUITO-X: A New Perspective on Context Compression from the Information Bottleneck Theory (2025.findings-emnlp)
Copied to clipboard
Yihang Wang, Xu Huang, Bowen Tian, Yueyang Su, Lei Yu, Huaming Liao, Yixing Fan, Jiafeng Guo, Xueqi Cheng
| Challenge: | Existing methods for compressing context by removing redundant tokens are inconsistent with the objective of retaining the most important tokens when conditioning on a given query. |
| Approach: | They propose a method that uses information bottleneck theory to compress context . they propose to remove redundant tokens using metrics such as self-information or perplexity . |
| Outcome: | The proposed method achieves a 25% increase in compression rate compared to the state-of-the-art . |
Implicational Universals in Stochastic Constraint-Based Phonology (D18-1)
Copied to clipboard
| Challenge: | Optimality Theory and Harmonic Grammar are constraint-based implementations of phonological theory that do not tamper with typological structure induced by categorical frameworks. |
| Approach: | They propose to model the implicational universals of phonological theory, called T-orders, and to use stochastic constraint-based frameworks to model them. |
| Outcome: | The proposed frameworks do not tamper with typological structure induced by categorical frameworks. |
Rhetoric, Logic, and Dialectic: Advancing Theory-based Argument Quality Assessment in Natural Language Processing (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on argument quality (AQ) focuses on overall quality, but there is no large-scale theory-based corpus and corresponding computational models. |
| Approach: | They propose to use a large-scale English multi-domain argumentative writing corpus annotated with theory-based AQ scores to assess argument quality. |
| Outcome: | The proposed methods improve argument quality in three domains and can be used as strong baselines for future work. |
Conspiracy Theories and Where to Find Them on TikTok (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies on TikTok's potential to promote and amplify harmful content have not been conducted. |
| Approach: | They analyze a longitudinal dataset of 1.5M videos shared in the U.S. over three years and evaluate the effects of TikTok’s Creativity Program for monetization. |
| Outcome: | The proposed model achieves high precision in detecting harmful content, but its overall performance is comparable to fine-tuned traditional models such as RoBERTa. |
Finding Friends and Flipping Frenemies: Automatic Paraphrase Dataset Augmentation Using Graph Theory (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Having high quality annotated data is crucial for training supervised machine learning models. |
| Approach: | They propose automated methods to improve NLP datasets by viewing them as graphs with expected semantic properties. |
| Outcome: | The proposed methods improve paraphrase models on pre-trained datasets. |
Developing a Rhetorical Structure Theory Treebank for Czech (2024.lrec-main)
Copied to clipboard
| Challenge: | a paper on the Czech RST Discourse Treebank is the first version of a textual annotation system based on the Rhetorical Structure Theory . document is annotated using the RST, a global coherence model proposed by Mann and Thompson . |
| Approach: | They introduce the first version of the Czech RST Discourse Treebank . paper presents an annotation process and provides corpus statistics and evaluation . |
| Outcome: | The paper presents the first version of the Czech RST Discourse Treebank . the treebank includes two gold annotations representing divergent interpretations . |
OpticE: A Coherence Theory-Based Model for Link Prediction (2022.coling-1)
Copied to clipboard
| Challenge: | Knowledge representation learning is a key step required for link prediction tasks with knowledge graphs (KGs). |
| Approach: | They propose a new embedding approach based on the physical phenomenon of optical interference to reduce the semantic ambiguity in KGs. |
| Outcome: | The proposed model can compete with existing methods on KG benchmarks. |
An Empirical Study of Memorization in NLP (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies see memorization as hindering generalization in deep learning models. |
| Approach: | They propose a long-tail theory to explain the memorization behavior of deep learning models . they use three different NLP tasks to test whether the theory holds . |
| Outcome: | The proposed long-tail theory is validated in three NLP tasks and shows it is faithful. |
Learning Latent Parameters without Human Response Patterns: Item Response Theory with Artificial Crowds (D19-1)
Copied to clipboard
| Challenge: | Incorporating Item Response Theory (IRT) into NLP tasks can provide valuable information about model performance and behavior. |
| Approach: | They propose to use IRT models generated from artificial crowds of DNNs to learn IRT. |
| Outcome: | The proposed model learning method outperforms baseline methods for two NLP tasks. |
Plan Dynamically, Express Rhetorically: A Debate-Driven Rhetorical Framework for Argumentative Writing (2025.emnlp-main)
Copied to clipboard
| Challenge: | Argumentative essay generation (AEG) is a complex task that requires advanced semantic understanding, logical reasoning, and organized integration of perspectives. |
| Approach: | They propose a debate-driven rhetorical framework for argumentative writing that integrates Bitzer’s rhetorical situation theory to improve logical depth, argumentative diversity, and rhetorical persuasiveness. |
| Outcome: | The proposed framework improves logical depth, argumentative diversity, and rhetorical persuasiveness over existing state-of-the-art models. |
NIM: Neuro-symbolic Ideographic Metalanguage for Inclusive Communication (2025.findings-emnlp)
Copied to clipboard
| Challenge: | ideographic metalanguage is a communication framework that transcends academic, linguistic, and cultural boundaries. |
| Approach: | They propose a universal ideographic metalanguage that leverages neuro-symbolic AI to create a system that transcends academic, linguistic, and cultural boundaries. |
| Outcome: | The proposed system transcends academic, linguistic, and cultural boundaries and enables semantic decomposition of complex ideas into simpler, atomic concepts. |
Like a Therapist, But Not: Reddit Narratives of AI in Mental Health Contexts (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models are increasingly used for emotional support and mental health–related interactions outside clinical settings. |
| Approach: | They analyze 5,126 Reddit posts describing use of AI for emotional support or therapy . positive sentiment is most strongly associated with task and goal alignment, they say . |
| Outcome: | The proposed framework analyzes language, adoption-related attitudes, and relational alignment at scale. positive sentiment is most strongly associated with task and goal alignment. |
Argumentation and Domain Discourse in Scholarly Articles on the Theory of International Relations (2025.coling-main)
Copied to clipboard
Magdalena Wolska, Sassan Gholiagha, Mitja Sienknecht, Dora Kiesel, Irene Lopez Garcia, Patrick Riehmann, Matti Wiegmann, Bernd Froehlich, Katrin Girgensohn, Jürgen Neyer, Benno Stein
| Challenge: | SKILL project aims to provide students with AI tools to facilitate analysis of argumentation in scholarly articles on international relations. |
| Approach: | They propose to use AI to analyze argumentation in scholarly articles on international relations . they use a dataset, discourse analysis, and baseline experiments to examine argumentation and domain content types . |
| Outcome: | The proposed method enables educationally-relevant insight into scholarly IR discourse . it requires domain-specific training and fine-tuning on relation and content type prediction tasks. |
Development of a General-Purpose Categorial Grammar Treebank (2020.lrec-1)
Copied to clipboard
| Challenge: | 'general-purpose' categorial grammar treebank is not tailored to specific variants of CG, but rather offers a theory-neutral linguistic resource that can be converted to different versions of 'type-logical grammar' . |
| Approach: | They propose a general-purpose categorial grammar treebank for Japanese that is not tailored to a specific variant of CG but rather offers a theory-neutral resource which can be converted to different versions of GC relatively easily. |
| Outcome: | The proposed treebank improves on the existing Japanese CG treebank on the treatment of certain linguistic phenomena (passives, causatives, and control/raising predicates). |
Pragmatic Norms Are All You Need – Why The Symbol Grounding Problem Does Not Apply to LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | 'Symbol grounding problem' is a philosophical problem that arises when questionable theories of meaning are presupposed. |
| Approach: | They argue that LLMs are vulnerable to Harnad’s symbol grounding problem (SGP), as it has been claimed recently . they trace the origins of the SGP to the computational theory of mind . |
| Outcome: | The proposed model-theoretic semantics does not give rise to the SGP, as it has been claimed in the literature. |
On Homophony and Rényi Entropy (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent theories of language optimality have tried to justify its prevalence, arguing that homophony enables the reuse of efficient wordforms and is thus beneficial for languages. |
| Approach: | They propose a new information-theoretic quantification of a language’s homophony: the sample Rényi entropy. |
| Outcome: | The proposed method is more nuanced than either Piantadosi et al.'s or Trott and Bergen's results. |
Generating Literature-Driven Scientific Theories at Scale (2026.acl-long)
Copied to clipboard
| Challenge: | Contemporary automated scientific discovery systems focus on generating experiments, but higher-level activities such as theory building remain underexplored. |
| Approach: | They propose to synthesize theories from scientific literature using literature-grounding versus parametric knowledge. |
| Outcome: | The proposed method matches existing evidence better than parametric LLM memory generation. |
Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation metrics are conflated and can mislead models, resulting in downstream harms. |
| Approach: | They propose a framework for conceptualizing and evaluating the reliability and validity of evaluation metrics based on empirical data. |
| Outcome: | The proposed framework formalizes the source of measurement error and offers statistical tools for evaluating evaluation metrics based on empirical data. |
A Probabilistic Inference Scaling Theory for LLM Self-Correction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated the capability to refine their generated answers through self-correction, enabling continuous performance improvement over multiple rounds. |
| Approach: | They propose a probabilistic theory to model the dynamics of accuracy change and explain performance improvements observed in multi-round self-correction. |
| Outcome: | The proposed model can predict accuracy curves and improve accuracy over multiple rounds. |
Defying Wikidata: Validation of Terminological Relations in the Web of Data (2020.lrec-1)
Copied to clipboard
| Challenge: | a new approach to validate terminological data retrieved from open encyclopaedic knowledge bases is needed . the legal domain is one of the most valuable areas of knowledge in the world . |
| Approach: | They propose to validate terminological data retrieved from open encyclopaedic knowledge bases by enriching them with information from existing resources in the Semantic Web. |
| Outcome: | The proposed method validates terms from open encyclopaedic knowledge bases in four languages. |
Rationalizing Medical Relation Prediction from Corpus-level Statistics (2020.acl-main)
Copied to clipboard
| Challenge: | Existing work on predicting relations based on text corpus has focused on analyzing raw texts mentioning two entities. |
| Approach: | They propose a framework that can be used to rationalize medical relation prediction . they recall contexts associated with the target entities and recognize relational interactions between them . |
| Outcome: | The proposed framework can achieve competitive predictive performance against a comprehensive list of neural baseline models, and present rationales to justify its prediction. |
IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models have demonstrated exceptional performance across a wide range of tasks . however, selecting the optimal LLM to respond to a user query often necessitates a delicate balance between performance and cost. |
| Approach: | They propose a multi-LLM routing framework that efficiently routes user queries to the most suitable LLM. |
| Outcome: | The proposed framework outperforms baseline methods in terms of effectiveness and interpretability. |
“I understand your perspective”: LLM Persuasion through the Lens of Communicative Action Theory (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can generate high-quality arguments, yet their ability to engage in nuanced and persuasive communicative actions remains largely unexplored. |
| Approach: | They examine whether Large Language Models express illocutionary intent in ways comparable to human communication by simulated online discussions . |
| Outcome: | The proposed models express illocutionary intents in ways comparable to human communication, and crowd-sourced workers prefer them over human-written ones. |
ISO 24617-12: A New Standard for Semantic Annotation (2024.lrec-main)
Copied to clipboard
| Challenge: | ISO 24617-12 is a proposed new standard 1 for the annotation of quantification phenomena in natural language. |
| Approach: | This paper proposes an annotation scheme for quantification phenomena in natural language as part of the ISO Semantic Annotation Framework (ISO 24617) it combines ideas from the theory of generalised quantifiers, from neo-Davidsonian event semantics, and from Discourse Representation Theory. |
| Outcome: | The proposed standard 1 is an annotation scheme for quantification phenomena in natural language. |
A Closer Look at Multidimensional Online Political Incivility (2024.emnlp-main)
Copied to clipboard
| Challenge: | 80% of the uncivil tweets are authored by 20% of the users, where users who are politically engaged are more inclined to use uncival language. |
| Approach: | They analysed 13K political tweets in the U.S. using crowd sourcing and classified them by their respective categories. |
| Outcome: | The proposed method enables us to characterise the distribution of incivility across users and geopolitical regions. |
Beyond Citations: Corpus-based Methods for Detecting the Impact of Research Outcomes on Society (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for assessing the impact of research are ineffective for identifying impact beyond academia and text-based indicators beyond those that capture attention. |
| Approach: | They propose a deductive and inductive approach to categorize research impact categories using a corpus-based approach . they use a combination of deductive methods and machine learning to infer impact categories from project reports. |
| Outcome: | The proposed method predicts deductively and inductively derived impact categories with 76.39% accuracy and 78.81% accuracy. |
Language Reconstruction with Brain Predictive Coding from fMRI Data (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies have shown that the perception of speech can be decoded from brain signals and subsequently reconstructed as continuous language. |
| Approach: | They propose to use FMRI-to-text decoding with Predictive coding to generate a main network and a side network to generate brain predictive representations from related regions of interest. |
| Outcome: | The proposed model outperforms current decoding models on several evaluation metrics on two naturalistic language comprehension fMRI datasets. |
MA-GTS: A Multi-Agent Framework for Solving Complex Graph Problems in Real-World Applications (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for solving complex problems are expensive and inefficient when handling large-scale, high-complexity problems. |
| Approach: | They propose a multi-agent framework that decomposes complex problems through agent collaboration by mapping implicitly expressed graph data into clear, structured graph representations and dynamically selecting the most suitable algorithm based on problem constraints and graph structure scale. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on multiple benchmarks with robust performance on both closed- and open-source models. |
HACHIMI: Scalable and Controllable Student Persona Generation via Orchestrated Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | ad-hoc prompting and hand-crafted profiles with limited control over educational theory and population distributions are often used for student personas. |
| Approach: | They propose a framework that generates theory-aligned, quota-controlled personas . they factorize each persona into a theory-anchored educational schema . |
| Outcome: | HACHIMI generates theory-aligned, quota-controlled personas for grades 1-12 . results show near-perfect schema validity, accurate quots, and substantial diversity . |
Culture is Not Trivia: Sociocultural Theory for Cultural NLP (2025.acl-long)
Copied to clipboard
| Challenge: | Cultural NLP has experienced rapid growth to meet the need to ensure language technologies are effective and safe across a pluralistic user base. |
| Approach: | They propose to use a well-developed theory of culture to clarify methodological constraints and affordances and offer theoretically-motivated paths forward to achieving cultural competence. |
| Outcome: | The proposed framework clarifies methodological constraints and affordances and offers theoretically-motivated paths forward to achieving cultural competence. |
Spanish Resource Grammar Version 2023 (2024.lrec-main)
Copied to clipboard
| Challenge: | Using the Freeling morphological analyzer, we encode a strict notion of grammaticality in the Spanish resource grammar. |
| Approach: | They propose to use the HPSG formalism to encode a Spanish resource grammar with a manually verified treebank of 2,291 sentences. |
| Outcome: | The proposed grammars encode a complex set of hypotheses about syntax and a strict notion of grammaticality making them a resource for natural language processing applications in computer-assisted language learning. |
Carefully Considering Culture: Analyzing LLM Alignment in Single- and Multi-Cultural Settings using Cultural Consensus Theory (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent work in NLP has examined large language models for their understanding of cultural norms across countries, ignoring group consensus or possible multicultural environments. |
| Approach: | They apply cultural consensus theory to the World Values Survey to model multidimensional nuance by ignoring group consensus or over-regularizing consensus. |
| Outcome: | The proposed model misrepresents cultural structures by failing to form cohesive consensus or severely over-regularizing consensus. |
Systematicity between Forms and Meanings across Languages Supports Efficient Communication (2026.acl-long)
Copied to clipboard
| Challenge: | Languages vary in how meanings map to word forms, but this theory does not account for systematic relations within word forms. |
| Approach: | They propose a model that measures the learnability of meaning-to-form mappings by inverse of simplicity. |
| Outcome: | The proposed model captures fine-grained regularities in linguistic form, allowing better discrimination between attested and unattested systems. |
Evaluating Sequence Labeling on the basis of Information Theory (2025.acl-long)
Copied to clipboard
| Challenge: | Existing metric families focus on certain aspects of sequence labeling tasks. |
| Approach: | They propose a metric that measures how much information each token contributes depending on different aspects of the sequence. |
| Outcome: | The proposed metric can satisfy all properties simultaneously. |
Emergent Relational Order in LLM Agent Societies: From Collective Affect to Authority Stratification (2026.findings-acl)
Copied to clipboard
| Challenge: | Fei Xiaotong’s Differential Order Pattern characterizes rural society as egocentric and relationally graded, with cooperation attenuating over social distance. |
| Approach: | They propose a multi-agent framework grounded in Affect Control Theory, Social Identity Theory, and Durkheimian collective affect. |
| Outcome: | Extensive simulations support interpreting Differential Order as a structure-sensitive emergent outcome of general social mechanisms. |
Theory-optimal Quantization Based on Flatness (2026.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to quantization of Large Language Models (LLMs) have been widely adopted due to activation outliers, which degrade model performance especially at lower bit precision. |
| Approach: | They propose a new metric for quantization that strategically distributes outlier magnitudes across matrix dimensions via optimized diagonal operations. |
| Outcome: | The proposed framework achieves less than 1% accuracy drop in W4A4 quantization on the LLaMA-3-8B model and reduces the performance gap by 39.1% on the more challenging W2A4KV16 model. |
A Structured Clustering Approach for Inducing Media Narratives (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to modeling media narratives miss subtle narrative patterns through coarse-grained analysis or require domain-specific taxonomies that limit scalability. |
| Approach: | They propose a framework for inducing rich narrative schemas by jointly modeling events and characters via structured clustering. |
| Outcome: | The proposed framework produces explainable narrative schemas that align with established framing theory while scaling to large corpora without exhaustive manual annotation. |
An Information-Theoretic Foundation for the Subregular Hierarchy (2026.acl-long)
Copied to clipboard
Mai Phan Quoc Hung, Khanh Nguyen Quoc, Đoàn Minh Luong, Duong Thu Ngan, Duong Thi Phuong Thao, Tuan Do
| Challenge: | Subregular theory posits that phonological patterns in natural languages occupy restricted region of formal hierarchy . phonology patterns in SL, SP, and Tier-based Strictly Local (TSL) languages are restricted . experimental evidence demonstrates humans fail to learn patterns outside these subregulate classes . |
| Approach: | They propose a subregular hypothesis that phonological patterns in natural languages occupy a restricted region of the formal language hierarchy. |
| Outcome: | The proposed framework offers a framework for understanding computational restrictions on natural language phonology. |